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NONLINEAR  MODEL  IDENTIFICATION 
FROM  OPERATING  RECORDS 

ABSTRACT 

Practical  considerations  are  given  for  the  use  of  MRAS  identification 
techniques  for  the  identification  of  linear  and  nonlinear  parameters  of 
dynamic  systems.  The  response  error  ("parallel  MRAS")  was  used  to  identify 
single  and/or  multivalued  nonlinear  parameters  whose  forms  and  "transfer 
function  equivalents"  were  unknown  a  priori.  All  parameter  adaptation 
occurred  simultaneously.  This  paper  develops  the  problem,  discusses  dif¬ 
ficulties  unique  to  the  nonlinearity  approach,  and  outlines  possible  solu- 


NONLINEAR  MODEL  IDENTIFICATION 


FROM  OPERATING  RECORDS 


I.  INTRODUCTION 

System  identification  has  become  a  refined  art  and  science  in  the 
last  twenty  years  [1-5],  at  least  as  regards  linear  system  parameter  iden¬ 
tification.  The  area  of  nonlinear  identification,  however,  has  been  some¬ 
what  neglected.  As  system  operation  requirements  are  tightened,  efficien¬ 
cy  and  energy  concerns  increase,  and  more  complex  systems  (large-scale 
systems)  are  contemplated,  the  need  for  detailed  accurate  knowledge  of  the 
full  system  structure.  Including  nonlinear  and  time-varying  effects,  is 
increased.  Some  examples  of  dynamic  systems  where  nonlinear  effects  are 
significant  include  power  plants,  high-performance  aircraft,  human  opera¬ 
tor  pilot-models,  and  transformers. 

The  objectives  of  the  present  work  are  to  develop  a  model  reference 
adaptive  system  (MRAS)  identifier  for  estimating  parameters  of  nonlinear 
pilot  models  to  ascertain  If  information  better  than  traditional  (Klelnman 
Optimal  Control  Model,  crossover  frequency  response  models)  linear  models 
can  result.  The  application  of  these  results  would  be  to  identify  human 
dynamic  models  so 

(1)  stress  lists/danger  vehicle  maneuvers  can  be  Investigated  safely 
by  applying  the  results  to  the  model,  not  the  human 

(2)  as  to  use  the  information  in  the  design  of  aircraft  control  sys¬ 
tems  and  for  predicting  closed-loop  flying  qualities 

(3)  as  to  determine  effects  of  environmental  inputs  such  as  tempera¬ 
ture,  vibration,  acceleration,  and  psychological  variables  such 
as  motivation,  training,  and  task  difficulty 

(4)  to  parameterize  changing  pilot  characteristics  during  glide-slope 
to  flare-up;  air  to  air  tracking  In  unsteady  maneuver,  and  hybrid 
(loose/tight)  control  situations 

The  concept  is  shown  in  Figure  i-i. 


The  control  of  physical  systems  using  modern  control  theory  has  become 
increasingly  important  with  the  advent  of  the  space  age  and  the  energy  cri¬ 
sis.  The  need  to  operate  systems  at  their  peak  efficiency  and  obtain  the 
utmost  in  performance  from  then  requires  that  the  control  system  have  ac¬ 
curate  knowledge  in  the  form  system  models  of  what  the  system  is  doing  and 
what  it  will  do  given  a  set  of  inputs  to  it.  A  special  section  of  control 
theory  known  as  system  identification  theory  is  responsible  for  developing 
accurate  models  of  physical  systems  using  the  input  into  the  plant  and  the 
output  of  the  plant  for  use  by  a  control  engineer  in  designing  control  sys¬ 
tems  and  to  facilitate  greater  understanding  of  the  physical  system. 

System  identification  can  be  divided  into  two  major  catagories:  (1) 
output  tracking,  and  (2)  parametric  identification.  Output  tracking  iden¬ 
tification  develops  models  for  systems  which  for  a  given,  fixed  input  will 
approximate  the  output  of  the  physical  system  or  plant.  Since  the  model  is 
good  only  for  a  particular  input,  output  tracking  is  of  little  significance 
for  identification. 

Parametric  identification  is  of  greater  importance  since  it  yields  the 
parameters  of  the  plant.  Thus,  output  tracking  occurs  for  any  type  of  in¬ 
put,  yielding  a  much  more  versatile  and  accurate  model  given  the  least 
amount  of  a  priori  knowledge  of  the  plant.  Parametric  system  identifica¬ 
tion  consists  primarily  of  three  classes:  1)  linear,  time-invariant,  2) 
linear,  time-varying,  and  3)  nonlinear,  time-invariant  identification. 

The  linear,  time-invariant  identification  Is  best  understood  and  most 
widely  used  because  such  approaches  are  simple  and  can  be  applied  easily. 
However,  In  many  physical  systems,  major  nonlinearities  occur  (l.e.  hyster¬ 
esis  in  power  systems,  saturation  in  electron  devices,  etc.)  for  which 
linear,  time- invariant  Identifiers  may  not  supply  an  accurate  description. 
Thus,  nonlinear  parametric  system  identification  has  become  a  subject  of 


increasing  importance  as  more  accurate  models  become  necessary. 

Two  key  approaches  exist  for  systems  with  one  or  more  nonlinearities. 

These  are  1)  when  the  nonlinear  form  is  known  a  priori  [17]  and  2) 

when  the  nonlinear  form  is  unknown  a  priori  [7].  The  first  approach  is 

predicated  on  knowledge  of  the  nonlinear  form  in  advance  (e.g.  quadratic 

curve,  symmetrical  saturation,  etc.)  or  where  the  nonlinearity  is  one  in 

2 

which  the  parameters  to  be  identified  enter  linearly  (e.g.  y  +  ay  +  cy  *  u 
The  second  approach  is  based  on  a  series  expansion  concept  (Taylor  series, 
power  series,  sine-cosine,  etc.)  for  piecewise  continuous  curve  fittings, 
when  no  a  priori  knowledge  of  the  nonlinearity  is  available.  This  latter 
approach  is  of  the  greatest  interest,  especially  in  regards  to  its  ability 
to  admit  memory  nonlinearities  (i.e.  hysteresis).  Figure  1-2. 

Several  different  forms  and  parameterizations  exist  for  modelling  non 
linearities  in  dynamic  systems.  These  include  1)  the  Haimerstein  model 
[8],  2)  Volteira  series  [9],  3)  Uryson  models  [10],  4)  memoryless  non¬ 
linearity  peicewise  series  fit,  5)  memory  nonlinearity  piecewise  series 
fit,  and  6)  known  nonlinear  model  structure.  A  methodology  using  forms 
4)  and  5)  which  has  been  developed  over  the  last  several  years  is  known  as 
Model  Reference  Adaptive  System  (MRAS)  Identification  [5].  MRAS  identifi¬ 
cation  techniques  can  be  broken  down  into  two  general  catagories:  1)  e- 
quation  error  or  "series  parallel"  and  2)  response  error  or  "parallel* 
methods.  Block  diagrams  of  these  methods  are  shown  in  Fig. 1-3.  The  pri¬ 
mary  differences  between  these  two  methods  are  the  way  the  error  is  formed 
and  the  way  stability  of  the  composite  system  is  assured.  In  the  equation 
error  MRAS,  the  error  Is  formed  as  a  difference  between  weighted  system 
output  states  and  input  states.  In  the  response  error  formulation,  the 
error  Is  formed  as  the  difference  between  the  system  output  and  the  ad¬ 
justable  model  output.  The  equation  error  system  does  not  guarantee  sta- 


CokictpT 


Figure 


Figure  1-3 


bility  of  the  system  while  the  response  error  system  can  guarantee  a  form 
of  stability.  It  is  this  form  of  stability,  known  as  hyperstability,  that 
has  motivated  the  recent  interest  in  the  response  error  or  parallel  MRAS 
that  this  thesis  is  concerned  with. 

Hyperstability  theory  was  developed  by  Popov  [21]  as  an  extension  of 
linear,  asymptotic  and  absolute  stability.  Its  use  in  linear  MRAS  iden¬ 
tification  assured  these  algorithms  were  stable  in  the  sense  of  hypersta¬ 
bility.  Thus,  the  parametric  identification  of  linear  dynamic  systems  un¬ 
der  the  hyperstability  conditions  is  assured;  a  very  strong  statement  which 
non  of  the  previous  methods  could  guarantee.  The  extension  of  hyperstabil¬ 
ity  assurance  for  nonlinear  systems,  then,  is  of  interest  in  order  to  as¬ 
sure  exact,  nonlinear,  parametric  identification. 

BACKGROUND 

Dynamic  system  identification  had  its  inception  in  statistics  [1,3], 
and  numerous  such  ad-hoc  identification  algorithms  exist.  However,  with 
the  resurgence  of  Lyapanov's  stability  theory,  the  field  of  MRAS  was  formed 
[5].  Lyapanov  designs  produced  several  algorithms,  but  these  were  of  lim¬ 
ited  value.  In  the  early  1960's,  though,  V.  M.  Popov  developed  hypersta¬ 
bility  theory  which  brought  about  a  radical  change  in  MRAS  identification. 
Hyperstable  MRAS  identification  algorithms  were  develoDed  by  Hang  [18], 
Landau  ,  and  Johnson  [12],  amongst  others,  which  accomplished  linear, 
time-invariant  identification  of  dynamic  systems.  Early  systems  were  con¬ 
strained  by  the  requirement  of  the  existence  of  a  strictly,  positive  real 
function  (SPRF),  but  in  1978,  Landau  and  Johnson  removed  this  condition  for 
hyperstability. 

Developments  of  the  response  error  MRAS  technique  into  nonlinear  sys¬ 
tem  parametric  identification,  however,  have  been  scarce.  In  1977,  Tomi- 
£jka  [20]  applied  hyperstability  theory  successfully  to  a  very  special 
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class  of  nonlinearities.  More  recently,  Colburn  and  Schatte  [22]  have 
applied  hyperstability  with  limited  success  to  nonlinearities  of  a  more 
general  type. 
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II.  MRAS  IDENTIFICATION  THEORY 


The  fundamental  concepts  and  theory  underlying  MRAS  identification  to 
the  present  will  be  discussed  in  this  section.  The  development  of  nonlin¬ 
ear  identification  is  a  straightforward  extension  of  these  basic  concepts. 
Two  major  MRAS  methods  will  be  developed.  This  is  followed  by  an  expose 
on  hyperstability  as  it  is  applied  to  the  MRAS  identification  process,  and, 
concluding,  with  the  proof  of  the  hyperstability  of  a  particularly  impor¬ 
tant  linear,  MRAS  identification  technique. 


MRAS  IDENTIFICATION  TECHNIQUES 


There  exis  two  primary  MRAS  identification  techniques:  (1)  the  equa¬ 
tion  error  (EE)  or  series-parallel  MRAS,  and  (2)  the  response  error  (RE) 
or  parallel  MRAS.  The  EE  method  shown  in  Fig.  II-l  was  expanded  on  by 
Lion  [17],  and  Kudra  and  Narendra  [6].  It  was  adapted  for  use  with  nonlin¬ 
ear  systems  by  Sprague  and  Kohr  [7]  and  Sthitoglu  and  Klein  [H],  Consider 
the  nonlinear  dynamic  system: 


V 


(n)  +  Vl(x(e))x(n'1) 


+  f 


i+1 


(x<h>)x<H,) 


+  F,(x(i)) 


f1.l(x(d))x(1'1) 


+  f0(x(s))x 


u  + 


g,(u(v))U(1) 


g 


m 


(2.1) 


where  an  -  constant. 


u  is  the  input  or  forcing  function,  x  is  the  state,  and  f^,  F^,  and  gm  are 
nonlinear  functions  of  the  indicated  argument.  Equation  (2.1)  contains 
two  types  of  nonlinear  functions,  f  and  F.  Functions  of  the  form  f^  and 
gk  are  assumed  to  be  single-valued  and  piecewise  continuous  with  fk(0)  =  0, 
such  as  shown  in  Fig.  II-2.  The  function,  F^,  of  which  only  one  may  occur 
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due  to  uniqueness  problems  with  the  constant  term  associated  with  the  func¬ 
tion^  assumed  to  be  piecewise  continuous  and  possible  multivalued.  Also, 

F . (0 )  f  0  necessarily,  see  Figure  I 1-3- 

Several  assumptions  on  (2.1)  must  occur: 

1)  n  >  m,  that  is,  the  order  n  of  x  must  be  greater  than  the  order  m 
of  u 

2)  the  system  input,  u,  and  output,  x,  must  be  measurable, 

3)  the  input,  u,  is  selectable  and  must  be  sufficiently  frequency 
rich  [7]  to  insure  parameter  adaptation,  and 

4)  the  system  may  possess  at  most  one  multivalued  nonlinear  function,  F. 


For  the  identification  process,  x  and  u  are  filtered  by  state  variable 
filters  (SVF)  which  develop  "pseudo-states"  which  are  approximations,  x  and 
u,  to  the  system's  actual  states,  x  and  u.  These  "pseudo-states"  are  then 
used  to  form  the  tracking  error  or  "equation  error": 

i .  v<->  *  ?n.1u(e))i(n-1>  * ...  -  f1+1<;(h>);<i+1)  - 

♦ ...  *  v;(s)>;  -  “  + 


♦  ...  *  L(i(9))i(m) 


(2.2) 


which  is  formed  from  (2.1): 


v<">  *  ♦  ...  *  *  F,(x’) 

♦  f,.1(x(d>>x(1-1)  ♦  ...  ♦  f0(x(s))x  -  u  -  9,<u(,))u(1)  - 
g  <u(9))u(m)  .  0  (2.3) 


of  the  actual  system  and  where  (•)  denotes  the  approximation  to  the  original 
function. 

Exact  identification  of  the  above  functions  entails  the  estimation  of 
an  infinite  number  of  points  which  describe  the  curve,  f  vs.  x.  This  is 
not  practical;  therefore,  an  approximation  is  sought.  Describing  each  of 
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the  functions  f^,  g^,  and  in  (2.2)  by  a  Taylor  series  expansion  in  in¬ 
tervals  over  the  expected  operating  domain,  piecewise  continuous  approxi¬ 
mations  to  the  functions  can  be  obtained.  For  the  single-valued  functions, 

A  A 

f  and  g,  these  expansions  take  the  form: 

f  ^(bhcoo  ,  r:  + :  #:(h)  -  w  . 

fku  }x  Laklp  ak2p  x  ‘  xhp'  •”  + 

a  (i(h)  -  7  r1  + 
akrplx  xhp;  **•  JX 


where 


k  denotes  the  function  being  expanded, 
r  denotes  the  position  in  the  series  expansion 


(•;  indicates  raising  the  argument  to  the  r-1  st  power  as  opposed 

to  (*)^  which  indicates  the  htb  derivative  of  (•)  with  respect  to 
time 


p  is  the  interval  index 

h  is  the  argument  index,  and 

7hp  is  the  expansion  point  in  the  ptb  Interval. 


For  the  multivalued  function,  F^,  the  expansion  appears  as: 
Fi(x(1))  *  +  ^i2p^x^  "  xlp)  +  •"  + 

Nrp(J<1)  +  ••  1 


(2.4) 


where  the  same  notation  as  above  applies.  The  nonlinear  identification 

A 

process  has  now  been  reduced  to  the  estimation  of  the  parameters, 

A1rp’  and  bjrp  where  b  are  the  parameters  associated  with  the  ex- 
panslon  of  the  gj (u v  ,)uvj;  functions.  The  error  equation  now  becomes 

E  *  a  x^  +  [i  .,  +  a  .  .  (x^  “  +  ...  + 

n  n-l ,1 ,p  n-i ,z,p  ep 

a  (x(e)  -  7  )r'1  +  +  +  Ta  + 

an-l ,r,p'x  xep'  ***  J  +  ...  +  La1+1jp  + 
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♦  [A,,.  *  -  x,J  *  ...  .  A.  fi(0  -  x..)r''  *  •■•  ] 


ilp  "i2p'"  "  "ip' . "irp'"  "  A1p' 

+  fa  +  a  (x^  -  x  )  +  +  a  /C(d)  -  7  )r“^ 

Lai-l,1p  a1-l,2pU  xdp'  •”  a1-l,rp(x  xdpj 


+  -iC(i’l)  +  +  Ta  +  a  (x^  -  7  )  + 

+  ...  jx  ...  +  LaQ^p  aQ2p'x  xsp'  •*• 


■  s/-'  ♦  —  [Snp  *  W“(v>  ■  uvp’  * 


i ,  (i(3)  -  u  )*...♦£  (G(3>  -  j  >r-’ .  ...  ]i(”> 

m2p'  gp'  mrp'  gp'  J 


(2.6) 


The  EE  method  is  derived  from  the  minimization  of  the  cost  functional 


1  :2 


J  =  ?E 


(2.7) 


By  taking  the  partial  derivatives  of  (2.6)  with  respect  to  the  parameters 


y  (i.e.  akrp),  the  steepest  descent  algorithm  is  obtained: 


•  „  30  „r  3E 

=  .K  .  _ke  — 


(2.8) 


where  K  is  a  positive  constant.  This  yields  the  parameter  adaptation  equa¬ 


tions: 


i  =  -g.  i  ;<"> 


n-l ,lp  *  "Gn-1 ,lp  E  x 


(n-1 ) 


*  *  -G  i  x(n-1)(x(e)  -  x  )r_1 

an-lrp  n-\rp  b  x  'x  xep' 


»  -G  ii(1+1) 
1+1  rp  fa1+ljlp  L  x 


-  -G  E  i(i+1)(i(h)  -7  )r-] 
1+1  rp  fa1+1;rp  t  x  'x  xrp 


iiip  •  -=.,p  E 


*  < 


II 

; i 


V 

u 


l 

I 


2  .h  i2w(2(»>-;  f' 

mrp  mrp  '  gp' 


G  -  0  r  )•  p 

•  •  i 


H  t  =  0  t  f  p 


(2.9) 


The  other  MRAS  approach  is  known  as  parallel  MRAS  or  response  error 
(RE),  Figure  I 1-4 .  Consider  the  following  linear  dynamic  system: 

(2.10) 


1-0  1  1-0  1 


and  corresponding  model: 


m  1-0  1  m  1-0  1 


Define  the  tracking  error,  e,  analogous  to  E  in  (2.2),  as 


e  *  x  -  x_. 

m 


(2.11) 


(2.12) 


Figure  I 1-4 .  Parallel  or  Response  Error  MRAS  Identification 
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This  error  is  then  processed  thorugh  a  compensator,  C,  to  yield  the  response 


error,  v,: 


.  e(n)  +  Z  c.e(1). 


(2.13) 


Hyperstability  theory  requires  that  the  transfer  function 

n-l  . 

1  +  z  c .  s 

«w  — 

1  -  z  a.s1 
i-0  1 


(2.14) 


be  a  strictly  positive  real  function  (SPRF)  for  asymptotic  hyperstability 
of  the  error  system  (2.13).  An  SPRF  is  defined  as: 


Re(G(s)}  >  0 


for  all 


(2.15) 


Re(s}  >  0. 

Hyperstability  also  yields  the  following  parameter  adaptation  equations: 


a.  =  Vx' 


bi  =  g.vu' 


V  i  e  [0,n-l] 


V  i  e  [0,m-l]. 


(2.16) 


Because  the  derivation  of  this  method  is  governed  by  exact  stability  theory 
(i.e.  hyperstability)  parameter  identification  is  guaranteed  provided  cer¬ 
tain  conditions  (to  be  discussed  in  the  next  section)  are  met. 

Landau  and  Johnson  removed  the  SPRF  requirement  by  insuring  that  it 
always  occurred.  They  did  this  by  adapting  the  c^  terms  in  (2.13)  by: 


cf  *  v  ev 


(2.17) 


In  doing  this,  the  transfer  function,  G(s),  became  unity  and,  therefore, 
always  an  SPRF. 

Tomljuka  [29]  applied  hyperstability  and  RE  identification  to  a  class 
of  nonlinear  systems  of  the  form: 
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x(t)  = 


fh/  *  ’Wi)0""'  *  ■■■  1  fhi°  *  fhO 

d"  *  VlD"''  *  •••  ♦  V  *  ag 


nh(u(t))  (2.18) 


for  m  <  n  and  D  =  where 


nh(u(t ) )  =  (u(t) )  +  n2(u(t))  +  ...  +  n£(u(t)) 


(2.19) 


are  known  static  functions  of  u(t)  and  the  constants  f^.'s  and  ' s  must 
be  identified.  Tomi-jsuka  showed  that  using  the  parameter  adaptation  equa¬ 
tions: 


V  Dl'X  ’  £  \  ”  ° 
fhj  =  kfhj  v  D  nh  j  e  h  e  kfhj-  >  0 


(2.20) 


the  transfer  function  (2.14)  remained  unchanged  and  that  this  algorithm 
was,  therefore,  hyperstable. 

RE  and  EE  identification  methods  yield  parameter  adaptation  algorithms 
similar  in  structure.  However,  there  are  several  fundamental  differences 
which  exist  between  the  two  methods.  Foremost  is  that  the  RE  method  is 
governed  by  hyperstability  theory,  while  the  EE  method  is  not  assured  to 
be  convergent.  The  RE  method  was  developed  through  hyperstability  so  that 
v  -*■  0  as  t  -*■  ».  The  EE  method  uses  gradient  following  techniques  to  min- 

a  ^  a 

imize  V ,  with  E  an  equation  error  analogous  to  v. 

Landau  shows  that  the  EE  identification  yields  biased  parametric 

estimates  in  the  presence  of  measurement  noise,  while  RE  yields  unbiased 

results.  In  the  nonlinear  case,  Colburn  and  Schatte  [21]  demonstrated  that 

the  RE  state  estimate  (i.e.  xm^)  is  much  more  noise  free  than  the  EE 

m 

state  approximations,  (i.e.  x'  '),  Figure  I 1-5 .  This  is  because  the  EE 
develops  the  state  information  by  filtering  the  noisy  input  and  output 
while  the  RE  develops  state  approximations  through  its  own  dynamics,  giv¬ 
ing  a  more  noise  free  approximation. 


- - * 


Figure  1 1-7 .  EE  Identification  of  hysteresis. 
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In  the  presence  of  good  {i.e.  no  noise)  state  information,  though, 
the  EE  will  identify  single-valued  and  multivalued  memory  type  (e.g.  hys¬ 
teresis)  nonlinearities  very  wel1,  see  Fig.  n_6,7  This  is  the  chief  advan¬ 
tage  of  the  EE  method  over  the  RE  method  because  the  RE  method  heretofore, 
has  not  been  applicable  to  nonlinear  identification. 

HYPERSTABILITY  CONCEPTS 

Hyperstability  plays  a  key  note  in  guaranteeing  the  stability  of  the 
RE  identification  technique.  It  is  a  generalization  of  linear  asymptotic 
and  absolute  stability.  Consider  the  system  shown  in  Figure  I 1-8, 


Figure  I 1-8  Basic  Hyperstability  System 

block  L  is  assumed  to  be  composed  of  linear  differential  equations.  If 
block  N  is  a  linear  feedback,  then  stability  bounds  may  be  derived: 

A,  <  A  <  A2  (2.21 ) 

where  -uj(t)  =  Av(t).  This  is  the  linear  asymptotic  stability  case.  If 
block  N  is  nonlinear  and  obeys: 


-u)(t)  =  <t>(v(t)) 

(2.22) 

cp(v)v  >0  V  v  f  0 

(2.23) 

$(0)  =  0 

(2.24) 

then  the  limits  on  block  L  and  4> ( v )  can  be  obtained.  This  is  the  absolute 
stability  problem.  Now  suppose  (2.23)  is  rewritten 

ft 

Jg  -  wfto  v(*t)  dt  >  0  V  t  >  0 


(2.25) 
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this,  then,  is  the  hyperstability  problem.  The  problem  can  be  stated  as 
find  the  conditions  on  block  L  given  a  block  N  such  that  condition  (2.25) 
occurs. 

To  begin  the  study  of  hyperstability,  suppose  that  block  L  may  be  de¬ 
scribed  as: 

gf  =  Ax  +  bw  (2.26) 

v  =  cx  +  doj  (2.27) 

Several  definitions  must  now  be  made: 

Definition  2.1 

Let  the  hyperstability  integral,  n,  be  defined  as 

n(0,t)  =  /*  -  wCt)  v(-l)  dr  (2.28) 

0 

Definition  2.2  Minimal  Stability 

The  system  (2.26-2.28)  is  said  to  posses  the  property  of  minimal  stabi¬ 
lity  if  for  any  initial  condition  x(0)  =  xQ  there  exists  a  pair  of  continu¬ 
ous  functions  x  and  w,  defined  for  t  _>  0,  and  satisfying  a)  equations  (2.26) 
and  (2.27),  b)  the  restriction 

t, 

n(0,t, )  =  /  -  w(r)  v(t)  dr  <  0  V  t,  >0,  (2.29) 

1  0  -  i  _ 

and  c)  the  condition 

lim  x ( t )  =  0  (2.30) 

Definition  2.3  System  Transfer  Function 

The  transfer  function  of  system  ( 2 . 26 ) - ( 2 . 27 )  is  defined  as: 

g(s)  =  C(sl-A)_1b  +  d.  (2.31 ) 

In  order  to  apply  hyperstability  to  a  system  (2.26)-(2.28)  it  is  nec¬ 


essary  that  three  conditions  for  this  system  (2.26)-(2.28)  be  satisfied. 
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The  first  condition  is  that  the  system  (2.26)-(2.28)  be  minimally  stable 
in  the  sense  of  Def.  2.2.  This  condition  is  acceptable  since  asymptotic 
stability  is  of  prime  importance  and,  if  the  system  (2 . 26 )- ( 2 . 28 )  is  not 
minimally  stable,  then  asymptotic  stability  in  the  presence  of  an  inte¬ 
gral  restriction  of  the  form  (2.28)  is  impossible.  The  second  condition 
is  that  b  f  0.  This  condition  is  obviously  necessary  since  the  solution 
of  (2.2 6)-(2.27)  is  not  a  function  of  u  and  the  problem  can  be  solved 
directly.  Finally,  the  third  restriction  is  that  the  transfer  function 
of  system  (2.26)-(2.27)  given  in  (2.31)  be  not  identically  equal  to  zero. 
This  is  necessary  because  if  (2.31)  was  identically  zero  then  n(0,t, ) 
would  be  identically  zero  and  (2.28)  would  be  meaningless. 

Given,  that  the  above  conditions  are  satisfied,  hyperstability  may 
now  be  defined. 

Definition  2.4  Hyperstability 

System  (2.26)-(2.28)  is  said  to  be  hyperstable  if  there  exist  posi¬ 
tive  constants  a,  8,  y,  and  such  that  the  following  two  properties  are 
satisfied: 

1 )  Property  Hs 


For  every  t  e  [tg,Tg]  and  every  solution  of  the  system  (2.26)- 
(2.28)  in  the  interval  [t0,TQ],  if  for  every  constant  8Q  >  0  for  which 


n(tQ,t)  <  Bg  V  t  e  [t0,T0] 

(2.32) 

then 

a| |x(t)| |  <  B0  +  Si |x(tQ)|  | 

(2.33) 

for  all  t  e  [tg.Tg]. 

2)  Property  Hp 

For  every  solution  of  the  system  (2. 26)- (2. 28)  in  the  interval 

L  ,  10 
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>l(t0,t)  >  -y|  | x(t0)  1 1  -  yI  i x ( tQ )  |  |  sup  ot |  |x(t )  (  [  (2.34) 


^  t  £ 

Simply  put,  if 

-Sg  1  n(0,t)  £  Yg  (2.35) 

2 

then  the  system  (2.26)-(2.28)  is  hyperstable,  and  if  g^  =  0,  then  the  sys¬ 
tem  is  asymptotically  hyperstable  [21]. 

The  results  of  Popov  show  that  if,  for  a  linear  system  (2.26)-(2.28), 
the  transfer  function  from  ui(t)  to  v(t)  given  by  (2.31)  is  a  strictly  pos¬ 
itive  real  function  (SPRF)  and  the  inequality  (2.34)  holds  then  the  system 
(2.26)-(2.28)  is  asymptotically  hyperstable.  Willems  [26-27]  showed  that 
the  SPRF  insures  that 

n(0,t)  -  J4  -  wCfc)  v(x)  dx  <  0  Vt>0.  (2.36) 

0 

RESPONSE  ERROR  IDENTIFICATION  -  APPLICATION  OF  HYPERSTABILITY 


Consider  the  linear  dynamic  plant: 


where 


»  =  B;\x(i)  +  m-1 


=  Z  a. 
i=0 


Z  b.u 


(i) 


i=0 


x  -  state  variable 
u  -  input  or  forcing  function 
a.,  b.  -  constants 


dt ' 

and  the  associated  model: 

n-1 


m-1 


x (n)  =  "z"  +  7 

m  i=0  1  m  i=0  1 


(2.37) 


(2.38) 
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Define  the  tracking  error  as: 


e  ■  x  -  x_ 


(2.39) 


and  the  error  dynamics  become: 


i=0  1  i=0  1  1  m 


m-1 

£  (b.  -  b.)u 
1-0  1  1 


(i) 


(2.40) 


Let 


v(t )  =  e^  •  I  C|  e^1 ^ 
1-0  1 


(2.41) 


then 


v ( t )  -  £  (a.  -  c.)e^  +  £  (a.  -  a.)x  ^  + 
1=0  11  i=0  1  1  m 


m-1 

S  (b,  -  b.)u 
i=0  1  1 


(i) 


(2.42) 


and  let 


j(t)  =  v(t) 


(2.43) 


The  hyperstability  system  now  is: 


» 


n-1 


n-1 


e'"'  =  £  a.e^  +  £  (a.  -  ajxj1^  + 

i=0  1  1-0  1  1  m 


m-1 

£  (bi  -  b.)u 


(i) 


1-0 


V(t)  .  .<")  -  "i1  cV> 


i*0  1 


0)(t)  =  v(t) 

where  e  is  defined  in  (2.39). 
Theorem  2.1 


(2.44) 


If  the  system  (2.44)  is  minimally  stable  and  the  input,  u,  into  the 
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plant  and  the  model  satisfies  a  frequency  richness  criterion,  then  the 
following  parameter  adaptation  equations  will  yield  the  hyperstability  of 

A  A 

system  (2.44)  and  the  parameters  a.  a.,  and  b..  +  b.  as  t  +  »: 


i  ■  Vm<,>v- 

ai 

>  0 

i  e  [0,n-l] 

(2.45) 

i  =  8iu(l)v, 

Si 

>  0 

i  e  [0,m-l] 

(2.46) 

.  =  y.e^v. 

Yi 

>  0 

i  e  [0,n-l] 

(2.47) 

Proof 

Since  u>(t)  =  v(t)  the  transfer  function  of  system  (2.44)  is 

G(s)  =  1  (2.48) 

which  is  an  SPRF,  thus 

n(0,t)  *  /*  -  u)(t)  v(t)  dx  <  0  V  t  >  0  (2.49) 

0  ~ 

The  other  bound  on  the  hyperstability  integral  must  now  be  determined,  that 
is 

n(o.t)  =  /*  -  u>(t)  v(t)  dx  >  -Y 1  (2.50) 

0  “  U 

Substituting  (2.42)  into  (2.50)  one  obtains 

n(0,t)  *  /t  E  -  (a.  -  c.)e^vdx  + 

0  i=0  11 

Jl  E  (a.  -  a.)x  (l)vdx  +  Z  -  (b.  -  b.)u(l)vdx  (2.51) 
0  1-0  1  1  m  0  1-0  7  7 

It  is  sufficient  to  look  at  each  of  these  terms  and  bound  them  individu¬ 
ally.  Thus 


^  Z  -  (a<  -  c.)e^vdx  >  -y2  , 
0  1=0  11  “  Y 


(2.52) 


/  E  -  (a,  -  a,)xmu;vdx  >  y2  ,  and 
0  1*0  1  '  m  -  a 


(2.53) 
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J*  V  -  (b.  -  b.)u(l)vdx  >  -■£  .  (2.54) 

0  j=0  1 

The  integration  and  summation  may  be  interchanged  in  (2 . 52 ) - (2. 54 ) 
because  they  are  independent  of  one  another,  and  since  the  resultant  is  a 
sum  of  integrals,  it  is  sufficient  that  each  of  these  be  bounded,  yielding: 


/*  -  (a.  -  cJe^vdx  >  -y2  ,  i  e  [0,n-l]  (2.55) 

0  1  Yi 

j*  -  (a.  -  a.)x _^vdx  >  -y2  ,  i  c  [0,n-l]  (2.56) 

0  1  1  ra  ~  i 

/t  -  (b.  -  b.)u(l)vdx  >  -Y2fl  .  i  e  [0,m-l]  (2.57) 

0  1  1  Bi 

Using  (2.55),  let 

f^t)  =  -(ai  -  c.).  (2.58) 

Differentiating  with  respect  to  t  yields 

^(t)  =  c.  (2.59) 

Define  the  c^  parameter  adaptation  as 

~C.*y.e^K,  y.  >  0  (2.60) 


Substituting  (2.60)  into  (2.59)  and  solving  for  f. (t)  yields 

f4(t)  *  y,  /*  e(i)vdx  +  f.(0)  (2.61) 

1  1  o  1 

/v 

where  f.(0)  =  -(a^  -  c^(0)).  Substituting  (2.61)  into  (2.55)  yields 


y.  /*  £  lT  ^vdx'  ]e^  ^vdx  +  f .  (0 )  J*  e^vdx  > 
1  0  0  0 


(2.62) 
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Using  Leibnitz's  rule: 

af  f  f(t',t)dT'  .  f  ff  dT'  +  f(T,T)  £ 

The  first  term  of  (2.62)  may  be  integrated.  Let 
f(x',x)  =  e(l  )(t‘  )v(t‘  ) 
and  use  Leibnitz's  rule  yielding: 

If  =  0  and 

f(t,r)  *  ^(t)v(t). 

Thus,  if 

F.(t^  =  fT  e^Kdr' 

0 

then  from  Leibnitz's  rule 

_1  *  e^(x)v(x) 
and 

dF..  =  e^ (t) v(t )dx. 

This  substitution,  (2.67),  puts  (2.62)  into  the  form 

Yd  Jt  F.(x)dF.(x)d  +  f. (0)  /t  e^vdx  >  -y2 
1  0  1  1  1  0  Y1 


which  yields. 


y-  [Jt  e^vdx]^  +  f,(0)/T  e^vdx  >  -y2 

£  n  * 


o  '  o 

Completing  the  square  in  (2. 71)  yields: 


Y1rrt  (i)  fi(0),2  fi2(0)  fi 

■yil*  e^'vdx  +  -Jr  r  -  -1^-  >  - 


■(0) 


=  Y2 

2Yi  Y  Y 


(2.63) 

(2.64) 

(2.65) 

(2.66) 

(2.67) 

(2.68) 

(2.69) 

(2.70) 

(2.71) 

(2.72) 


Thus,  the  boundedness  of  (2.55)  has  been  proved  with  the  given  parameter 


adaptation  (2.47).  Using  similar  substitutions: 


g.j(t)  =  -(ai  -  a.)  and 


hi (t)  =  -(bi  -  b.) 


(2.73) 

(2.74) 


the  boundedness  of  (2.56)  and  (2.57)  can  be  proved  using  the  parameter 
adaptation  (2.45)  and  (2.46),  respectively.  Since,  all  the  integrals 
(2.55)-(2.57)  are  bounded  the  boundedness  of  (2.51)  is  assured  and  is  equal 
to 


2  n-1  f  2(0)  n-1  g  2(0)  m-1  h  2(0) 

A  =  z  - -  +  z  -x - +  z  -4 - 


i  =0  2Yi 


z  -5— 

i=0 


i=0  2si 


or,  substituting,  for  f.(0),  g^(0),  h..(0) 

o  n-1  [c.(O)  -  a.]2  n-1  [a - (0)  -  a.]2 

y_  =  z  — - —  +  z  — l— - - —  + 


i=0 


2^i 


Z 

i=0 


2ai 


(2.75) 


m-1  Cbi (0)  - 
i--0  Wi 


(2.76) 


and  the  theorem  is  proved. 

Theorem  2.1  was  proved  under  the  assumption  of  minimal  stability  of 
the  system  (2.44).  The  following  theorem  gives  the  requirements  on  the 
plant  (2.37)  in  order  for  minimal  stability  to  hold. 

Theorem  2.2 


If  the  plant  (2.37)  is  asymptotically  stable,  then  the  error  system 
(2.44)  is  minimally  stable. 

Proof 

Minimal  stability  requires  that  for  any  initial  condition  e(0)  =  eQ, 
a  pair  of  functions  u(t)  and  e(t)  exists  such  that 

1 )  n(0,t)  £  0  and 

2)  lim  e(t)  =  0. 

t-+« 

Define 
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n-1  a.  /  •  \ 

U'(t)  =  I  (a.  -  a.)x  m  +  E  (b. 
i=0  1  1  m  1=0  1 


b.  )u 


(i) 


(2.76) 


then  (2.40)  becomes 


n-1 


(n)  =  Z  a.e('UU'(t) 


Let 


i*0 

n-1 

j(t)  =  E  (a,  -  c.)e 


(D 


i=0 


(2.77) 


(2.78) 


(this  can  be  done  by  setting  a^  =  a^,  i  e  [0,n-l]  and  b.  !  b^,  i  e  [0,m-l] 
in  (2 .42 )- (2.43) ,  and  is  certainly  an  allowable  w(t)).  By  using  this  w(t), 
u'(t)  =  0  and  (2.77)  becomes 

e(n)  =  V  a.e(l>  (2.79) 
1*0 


which  is  asymptotically  stable  only  if  the  plant  is  asymptotically  stable 
for  any  initial  condition  x(0)  *  xQ.  Since  the  w(t)  was  chosen  from  a  set 
for  which 

-Yo£n(0,t)<0  (2.80) 


then  the  first  condition  of  minimal  stability  is  maintained  and  the  theorem 
is  proved. 

The  frequency  richness  criterion  in  Theorem  2.1  was  discussed  by 
Sprague  and  Kohr  [7].  They  showed  that  for  parametric  identification  to 
occur  when  the  error  was  identically  equal  to  zero  the  number  of  distinct 
frequency  components  of  the  input,  u,  to  the  plant  and  model  is  given  by 

N  *  n  -  ,  (2.81) 

when  the  parameters  to  be  identified  were  the  a{,  i  e  [0,n-l]  and  b^ , 
i  e  [0,m-l],  and  the  plant  was  linear.  They  showed  this  mathematically 
for  the  linear  plant  and  no  zero  case  and  inferred  it  experimentally  in 
the  general  linear  case.  For  the  nonlinear  case  it  was  found  to  be  at 


least  as  large  as  (2.81).  For  the  case  in  which  there  are  also  adaptive 
c.  terms  the  number  of  distinct  frequencies  was  found  to  be  equal  to 


2n  +  m  +  1 
2 


(2.82) 


using  experimental  results  and  empirical  inferences. 

The  development  of  nonlinear  RE  identification  algorithms  is  based  on 
the  linear  algorithm  presented  here.  Its  proof  is  very  similar  to  the 
proof  just  presented. 
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III.  HYPERSTABLE  NONLINEAR  RESPONSE  ERROR  IDENTIFICATION  (HNREI ) 

The  development  of  linear  MRAS  identifiers  and  hyperstability  prin¬ 
ciples  along  with  the  nonlinear  concepts  of  the  EE  method  lead  to  the  de¬ 
velopment  of  nonlinear  RE  identification  techniques.  Heretofore,  the  ex¬ 
tension  to  nonlinear  identification  using  the  RE  method  has  been  thwarted 
by  the  requirement  of  the  SPRF  which  is  not  defined  for  general  nonlinear 
systems.  However,  with  Landau's  [11]  and  Johnson's  [12]  papers  elimina¬ 
ting  the  SPRF  difficulty  through  problem  reformulation,  an  approach  for 
HNREI  algorithms  now  exists.  In  this  chapter  two  different  nonlinear 
identifier  formulations  will  be  presented  and  two  nonlinear  identification 
algorithm  proved  to  be  hyperstable  are  given. 

Nonlinear  Formulations 

For  the  development  of  HNREI  algorithms,  two  nonlinear  formulations 
were  considered:  1)  piecewise  linear  expansions  in  intervals  of  the 
state  space  and  2)  power  series  expansions  over  the  entire  state  space. 

Both  of  these  have  distinct  advantages  and  disadvantages.  The  piecewise 
linear  expansion.  Figure  III-l,  allows  the  nonlinear  function  to  be  divided 
into  a  series  of  intervals  in  the  state  space  and  a  linear  approximation  to 
the  nonlinearity  formed.  This  method  has  a  serious  disadvantage,  though, 
when  perfect  state  information  is  lacking.  Figure  I I 1-2 .  It  is  possible 
that  the  identification  algorithm  could  be  adapting  a  parameter  in  the  wrong 
interval  yielding  erroneous  results.  Thus,  the  degree  of  accuracy  obtain¬ 
able  by  the  piecewise  linear  formulation  decreases  with  the  loss  of  per¬ 
fect  state  information. 

The  power  series  expansion  technique.  Figure  I I 1-3,  uses  a  continuous 
approach  and,  hence,  does  not  suffer  from  the  interval ization  problem  as¬ 
sociated  with  the  piecewise  linear  method.  The  power  series  method  attempts 
to  approximate  the  actual  nonlinear  function  as  a  finite  power  series: 
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f(x)  =  £  a.x1 .  (3.1 ) 

i=l  1 

The  principal  disadvantage  of  this  method  is  that  for  some  nonlinearities 
which  can  be  approximated  with  a  small  number  of  intervals  using  the  piece- 
wise  linear  expansion  may  require  many  terms  using  a  power  series  expansion. 
Noisy  state  measurements  also  present  problems  because  of  the  possible 
high  degree  of  the  polynomial  and  noise  biasing. 


Nonlinear  Identification  Algorithms 

The  nonlinear  expansion  techniques  just  discussed  were  used  to  de¬ 
velop  HNREI .  The  piecewise  linear  HNREI  required  a  special  interval  con¬ 
dition  to  insure  hyperstability  while  the  power  series  expansion  technique 
required  no  special  conditions. 


Piecewise  Linear  HNREI 

Consider  the  following  nonlinear  plant: 

n~l  fl\  /n\  m~l 


x^  =  £  f.(x^)  +  g  (x^)  +  £  h.(u(l^) 
i=0  1  *  i=0  1 


m 


with  a  corresponding  model: 

n-1 


\n 


where  (*)^  =  -  ,  and  l  e  [0,n-l].  Let 


dt 

fl(x(f,)-a11px(1) 

MxU)>  =  aH0p  +  a£lp(xU)  "  V 

hl(u(1))  =  biipu(^ 


(3.2) 


(3.3) 


(3.4) 

(3.5) 

(3.6) 


which  have  corresponding  model  nonlinearities 
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f  (x  ^)  *  a  x  W 
Ti  xm  >  ailpxm 

W*’1  -  “top  *  »llp(xm 


U)  _  7 


xm£p^ 


where  p  denotes  the  pth  interval  of  the  state  space  or  u^. 


the  plant  and  model  may  be  rewritten,  respectively,  as: 

i- 

E  a 


m-1 


i=0 

m 

(i) 


ilp 


+  a01  (x(i)  -  x„J  + 


£0p  £lp 


*p' 


1-0  l1p 

X  ^  =  E  ailDxJ^  +  3?.nn  +  a5ln  (Xm 
m  ,  q  ilp  m  £0p  £lp  m 

\n 


U)  _  7 


(3.7) 

(3.8) 

(3.9) 
Thus, 


(3.10) 


V  * 


m-1 

2  b.lnu 
i*0  7lp 


(i) 


(3.11) 


where  the  parameters  b^p,  a^p*  a£0p’  and  a£lp  must  be  1dent^ed  in  each 
interval  p.  Define  the  tracking  error  as 


e  =  x  -  x_ 
m 


(3.12) 


The  error  dynamics  which  are  to  be  made  hyperstable  are: 

6  ~  -j^Q  ailpe  *  a£lp^X£p  *  Xm£p)  +  a£0p  ~  a£0p 


+  (3£ln  “  3  0  1  n  ^  ( X, 

m-1 


U)  r 


n-1 


‘£lp  “£lp/v/'m  '  xm£p)  +  £Q  (ailp  “  ailp 

i7£ 

*  i=o  (bnp  •  bitp)u(1) 


)x 


(i) 


(3.13) 


Let 


v(t)  = 


n-1 

E 

1*0 


(3.14) 


-  .  .. 


37 


then 


n-1 


v(t)  =  X  (a,.  -  c.,)e'  1  -  a„.  (x.  -  x  -  )  + 


i=0 


'ilp  ilp 


(i) 


£lp  £p  m£p 


aitOp  "  StOp  +  ^a£lp  ‘  a£lp^xm^  "  Vp^  + 


m-1 

£  (a^„  “  a„Jx, 
i=0 

m 


m-l 

(i)  +  X  (b,,  -  b.,  Ju 


ilp  ilp  m 


i=0 


ilp  ilp 


(i) 


(3.15) 


Def i ne 

u)(t)  =  v(t)  (3.16) 

The  hyperstability  system  is  given  by  (3.13),  (3.14)  and  (3.16). 

Theorem  3.1 

If  the  system  (3.13)-(3.16)  is  minimally  stable,  the  input,  u,  into 
the  plant  and  the  model  is  sufficiently  frequency  rich,  and  the  condition 
x.  ■  xmAp  are  satisfied,  then  the  following  parameter  adaptation  equations 
guarantee  the  hyperstabil ity  of  system  ( 3 . 1 3 ) - ( 3 . 1 6 )  and  the  parametric 


i dent 1  f i  cat i on :  a£0p 

-  a£0p’  ailp 

*  *nP*  and  bnP  *  bnp as  *  * 

oo : 

X 

aM)p  = 

atOp 

V 

“top  *  0 

(3.17) 

• 

atip 

atlp 

<l) 

-  W’  “mp  ” 0 

(3.18) 

X 

ailp  = 

ailp 

vxn.(1> 

1  e  CO.n-l  J.  i  t  U  a„p  >  o 

(3.19) 

X 

bilp  = 

8ilp 

Bilp  >  o,  i  e  [0,m-l ] 

(3.20) 

X 

Cilp  “ 

Yilp 

«(*>. 

Yilp  >  0,  i  e  [0,n-l] 

(3.21) 

Proof 

Since  w(t)  s  v(t), 

n(0,t)  =  Jfc  -  w(t)v(x)dT  <  0  (3.22) 

0 
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and,  thus,  one  limit  on  n(0,t)  is  established.  To  establish  hyperstability 


the  other  limit  must  be  satisfied: 


n(0,t)  =  /*  -  w(x)v(x)dx  >  -y? 

0  u 

Substituting  (3.15)  into  (3.23)  for  w(x)  using  (3.16)  yields 

n(O.t)  -  /*  2  -  (a11p  -  c.lp)e(i)vdr  +  f*  ag1n  . 


(3.23) 


0  1-0 


Wp  -  Vp)vdT  *  -  (al0p  -  at0p,vdT 


~<al0p  •  at0p)vdT. 


3* /* " 

J  0  i 


f0  -  fbilp  -  bilp)u  vdT^  "Yo  {3-24) 


It  is  sufficient  to  bound  each  of  the  terms  in  (3.24)  in  order  to  insure 
the  boundedness  of  (3.24)  and  by  exchanging  the  integration  and  summation 
of  terms  1,  5,  and  6  and  using  the  same  sufficiency  argument  (3.24)  yields: 


/J-‘ai.p-W*<,)«hi  A11p , 


16[0,n-l]  (3.25) 


;0  ■  (a>»P  •  a*op)vdT  -  Y\oP 

C  ■  Kip  -  -  W,dT-  V 


(3.26) 


(3.27) 


/*  -  (aiip  •  aiip>%<1>vdT  --\,p  f  e  w  (3-28> 


Jl  "  i n  -'bn>(l)vdx  >-yfl  i  e  [0,m-l] 
0  llp  llp  “  0ilp 


(3.29] 


Using  (3.25),  let 

filp(t)  s  '{ailp  ’  cilp)‘ 

Differentiating  (3.30)  with  respect  to  time  yields: 


(3.30) 


f11p(t)  =  c11p 


(3.31) 
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40 


a 


.(0) 


£lP  C/'  (XmU)  -  XmJn)vdT  ♦  ]2  -  Vlfi- 

0  m  m*P  a£lp  2a£lp 


(0) 


-  2a 


lip 


=  -  Y 


o t. 


ilp 


m 

tx 

2ailp  ailp 


ailp 


Up 


(3.39) 


(3.40) 


where 


SiiE.  [/*  u<1)vdx  tHi!£^.]2 
2  0 


eilp 


h  ilp(°> 


26, 


ilp 


■  -y; 


ilp 


hi1p(t)  -  -(bilp  -  b.lp). 


h  t1p(0)  > 

“<T  - 


(3.41) 


(3.42) 


Thus,  all  of  the  integrals  (3.25)-(3.29)  have  been  bounded,  and, 
therefore,  the  integral  (3.24)  is  bounded  by  -Yq  where 

n-l  f2  (0)  n-1  g2.,  (0)  m-1  h2  (0) 

y2  s  x  V P  —  +  i  — up, —  +  x  -  1‘P  —  + 

0  ,_n  2Y{i_  2a. ,_n  26, 


i =0  'ilp 


1-0  c“ilp 

m 


i=0  Pilp 


g2£0p^  +  g2£lP^°^ 
2aori„  2a 


£0p 


tip 


(3.43) 


or,  substituting  for  f11p(0),  9^-j p(0) »  h-lp(0) 


n-l  (a, , n(0)_a, , n-l  (a,,  -a.1n)‘ 
v2  =  r  — LlP—  _ HE - (.  x  — —  P.  - 

Y0  2Yo.  ,-n  2a, 


'ilp 


1-0 

i><£ 


l11p 


t-o 


(bn  p'hjip^ 


26 


ilp 


+  ^a£Qp~a£Qp^  +  (a£lD~a£lp^ 


"ST 


2.0  p 


1ST 


tip 


(3.44) 


Thus 
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-Yq  l  n(0,t)  <  0 


(3.45) 


and  hyperstability  is  proved. 

The  conditions  for  minimal  stability  of  the  error  system  (3.13)-(3.16) 
are  given  in  the  following  theorem. 

Theorem  3.2 

If  the  plant  (3.10)  is  asymptotically  stable,  then  the  error  system 
(3.13)-(3.16)  is  minimally  stable. 

Proof 


The  proof  of  Theorem  3.2  parallels  the  proof  of  Theorem  2.2.  Let 


n-1 


=  i=E0  ^ailp~Cilp^  a£Op’aiUp^X£p'Xrn£.p) 


(3.46) 


By  using  this  input,  the  error  system  becomes: 

e(n)  _  Hf-1  a  e(0  +  a  +  a  r/xU)_7  ). 
6  i*o  ilp6  *°P  alPL 

m 

(x  (£)-x  )] 

'xm  *m£p;j 


(3.47) 


by  setting 


and 


a£0p  =  0 

A 

a£lp  =  ailp 


i  e  [0,n-l] 


biiP  =  biiP  1  e 

J'ht)  -  o  i  e  n,m- 1] 

xm(i)(0)  *  0  1  e  [0,n-l]. 


(3.48) 


Thus,  (3.47)  becomes 


,(")  .  nz  a  x(i)  +  a  +  a  (x(£)-7  ) 
i=0  ^P  £°P  *lpU 


(3.49) 


which  must  be  asymptotically  stable  in  order  to  insure  the  minimal  stabil 
ity  of  (3.1 3)-(3.16) -  The  final  condition  of  Theorem  3.1^ 


(3.50) 


requires  substantive  a  priori  knowledge  of  the  plant.  This  type  of  know¬ 
ledge  is  not  readily  available  and  condition  (3.50)  limits  the  piecewise 
linear  HNREI. 


Power  Series  HNREI 

Consider  the  following  nonlinear  plant: 


C(n)  =  [  I1  aiiX(i)j]  +  V  [  E1  b.V1^] 

1=0  j=1  1J  1=0  j=l  1J 


(3.51) 


where  k.,  1.  is  a  finite  integer  and  (*)^^  indicates  d  raised  to  the 
1  1  dt1 

jth  power.  This  plant  has  a  corresponding  model: 


I'M.  'll! 

m  i=0  j=0  m  1=0  j=l  1J 


E  [  E  a^x 
i=0  j 

Define  the  tracking  error  as: 


e  =  x  -  x. 


(3.52) 


(3.53) 


and  the  error  dynamics  become 

n-1  ki 


(n)  =  "e'  [  s’  a^(x(i)j-x(i)j)]  +  "l  [  E1  ( 


1=0  j=l 


Mj 


m-1 


+  E  [  E1  (bii-bi1)u(l)j] 
i=0  j=l 


a  -2  lx  {i)j1 
°  v“li  aii,xm  J 

i=0  j=l  1J  m 

(3.54) 


Let  the  response  error  be  defined, 

n-1 


k.  • 


'(t)  =  e(n)  -  E  [  E1  cf,(x(i)j-x  (i,j] 
1=0  j=l  1J  m 


(3.55) 


and  define 
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Thus,  the  error  system  to  be  made  hyperstable  is  (3. 54)- (3. 56). 

Theorem  3.3 

If  the  system  (3.54)-(3.56)  is  minimally  stable,  and  the  input,  u, 
into  the  plant  (3.51)  and  model  (3.52)  is  sufficiently  frequency  rich, 
then  the  following  parameter  adaptation  equations  insure  the  hyperstability 
of  system  (3. 54)- (3. 56)  and  the  parameter  convergence 


aij"aij*  bij"bij  ast"“: 
(i  )j 


aij  =  “ijV  Jv  ie[0.n-l],  je[l,ki],  <*^>0  (3.57) 


b. j  =  B^u^v  ie[0,m-l],  jc[l ,A1  ],  6ij>0 


(3.58) 


cij  =  TijCx^^-xm^^]v  ic[0,n-l  ],  jc[l  ,k1  ] ,  y^O  (3.59) 


Proof 


Since  (3.56)  holds  the  upper  limit  of  n(0,t)  defined  as 

n(0,t)  =  J’t  w(t)  v(t)  dt  <  0. 

0 


(3.60) 


Thus,  the  other  limit  for  (3.60)  must  be  obtained  to  prove  hypers  lability. 
Substituting  (3.55)  and  (3.56)  into  (3.60)  yields: 

n(0,t>  “  CjV  (aU^iJ)(x(')','Xm(’>J],dT 

♦  /*  V  [  i  -  j>xm(l,J3vdT  *  /*  z' - 

0  i=0  j*0  m  0  1=0 


(bij-bij)u^^]vdT  >  -Yq  (3.61) 

By  using  a  sufficiency  argument  similar  to  that  used  in  Theorem  2.1  and 
Theorem  3.1,  (3.61)  can  be  written: 


(3.62) 


jeCl.k.] 

(aira1j)x«(,)JvdTi-Yilj  1et°*n_1J»  jeCl,ki3  (3.63) 

/*  -  (b.j-b.jju^^vdx  _>  ie[0,m-l],  je[1  ,£i]  (3.64) 


Also,  following  an  argument  similar  to  Theorem  2.1  and  Theorem  3.1,  and 
defining 


(3.65) 

(3.66) 

(3.67) 

the  inequalities  (3.62)-(3.64)  are  found  to  be,  respectively. 


lii  «>j)vdT  +  .  4^ > 

1  0  m  Yij  ^Yij  ~ 


f21i{0) 

- U -  =  -y2 

2y,4  \U 


!u  £/tx  «)jvdT  +  !uE]« .  fu!£l  > .  fjiil . 

2  U0\  a,j  J  a,,j  -  2«fJ 


-Y, 


ai  j 


h4,(0)  ,  h2,,(0)  h2  (0) 


Bij  [/*  U(i)^VdT  +  -i^-]2  -  -U  -  >  -  lil 

-fV  8«  J  26u  -  2eu 


(3.68) 


(3.69) 


which  bounds  (3.61)  by  -Yg  where 


(3.70) 
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ki 


n-1  . 

=  z  {  E 

U  i=0  j=l  ^Yij 

4i  (bi1(0Ui1)2 

LL _ U _ ] 


<;j0)- o2 


_L1 


m-1 

srr0-^  *  * 

lj  1*0 


[  z 

j-1 


2siJ 


(3.71) 


where  the  initial  conditions 

f(J(0)  .  ;fJ(0)  -  afj 

9,j(0)  .  :,j(0)  -  afj 
and  h,j(0)  ■  £,j«>)  -  »,j 


(3.72) 

(3.73) 

(3.74) 


have  been  substituted  in  (3.68)-(3. 70)  to  obtain  (3.71),  and  hyperstability 
is  proved. 

The  conditions  on  the  plant  (3.51)  to  insure  minimal  stability  of  the 
error  system  (3.54)-(3.56)  are  obtained  in  the  following  theorem! 

Theorem  3.4 


If  the  plant  (3.51)  is  asymptotically  stable,  then  the  error  system 
(3.54)-(3.56)  is  minimally  stable. 

Proof 

The  proof  of  this  theorem  parallels  that  of  Theorems  2.2  and  3.2  and 
consists  of  finding  a  w(t)  such  that 


1 )  n(0,t)  <_  0  and 

2)  lim  e(t)  *  0 

t-H» 

for  any  initial  condition  e(0)  «  eg.  Let 

w(t)  *  V  [  I*  (a11-ci1)(x(1,J-*  (1,j)]  (3.75) 

i*0  j=l  1J  13  m 


by  letting 


(3.76) 


(3.77) 
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The  error  equation  (3.54)  then  becomes: 


e 


(n) 


n-1 

E  C  Z 
1-0  j=l 


a  (x(i)j-x  (i)j 
aijU  xm 


)] 


(3.78) 


which  has  lim  e(t)  =  0  only  if  the  plant  (3.51)  is  asymptotically  stable. 
t->® 

Thus,  minimal  stability  is  proved. 

Thus,  two  HNREI  algorithms  have  been  developed  which  yield  parameter 
adaptation.  This  parameter  convergence  is  guaranteed  if  the  plant  is  asymp¬ 
totically  stable  and  the  input,  u,  to  the  plant  and  model  is  sufficiently 
frequency  rich.  The  next  section  discusses  methods  of  implementing  these 
algorithms  and  design  criteria  associated  with  them. 
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IV.  DESIGN  REQUIREMENTS 

In  the  design  of  nonlinear,  parametric  identifiers,  several  design 
considerations  must  be  made.  These  considerations  can  be  roughly  grouped 
into  two  catagories:  1)  what  type  of  identifier  is  to  be  chosen,  and  2) 
specific  nonlinearity  considerations.  The  answer  to  the  first  depends 
on  the  a  priori  knowledge  of  the  nonlinear  system  and  the  maount  of  noise 
in  the  system.  If  the  functional  form  of  the  nonlinearities  is  known, 
then  a  linear,  time-invariant  identifier  might  be  advised.  Similarly,  if 
the  nonlinearity  forms  are  unknown  and  only  small  (<1%)  amounts  of  noise 
exist,  then  the  series  parallel  (equation  error)  MRAS  approach  might  be 
best.  The  criteria  for  choosing  between  identifiers  is  largely  a  func¬ 
tion  of  experience.  However,  with  unknown  structure  nonlinearities  in 
the  presence  of  noise,  parallel  MRAS  yields  best  results. 

Fig.  I V- 1  shows  a  general  block  diagram  of  the  nonlinear  response 
error  parametric  identification  algorithm.  The  algorithm  may  be  broken 
into  two  main  loops.  The  inner  loop  consists  of  state  variable  filters 
(SVF)  adjustable  model,  dynamic  compensator  ( N( s ) ) ,  and  the  parameter 
adaptation.  This  inner  loop  presents  several  considerations  for  the  de¬ 
signer: 

1 )  SVF  design 

2)  Parameter  gains 

3)  PRF  and  the  dynamic  compensator  design 

The  SVF's  function  is  to  provide  "pseudo-derivatives"  for  use  in  develop¬ 
ing  the  response  error.  If  p  ■  ^  then  L(p)  denotes  the  SVF  and  (1)  be¬ 


comes 


L{pnxP)  +  ...  +  L[Fi(pjxp)  +  ...  +  L[f0(pkxp)xp]  = 
LC90(p%)up]  +  •"  +  L[9m(pWup)up] 


(4.1) 
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where  xp  and  up  are  the  plant  output  and  input  respectively.  Sprague  and 
Kohr  [7]  have  shown  that  if  !_(•)  is  a  transport  operator  then  L(*)  corranutes 
with  the  nonlinearity  to  give 

L(pnxp)  +  ...  +  [F .  L(pjxp)  +  ...  +  fQ[L(pkxp)]  xp  = 

g0[L(piup)]up  +  ...  +  gm[l(pwup)]up  (4.2) 

allowing  the  SVF  to  be  moved  from  the  output  of  the  model  to  its  input. 

This  gives  compatability  between  the  model  states  and  the  corresponding 
plant  "pseudo-states". 

Parameter  gains  should  be  chosen  in  such  a  manner  as  to  give  rapid 
convergence  and  decrease  asymptotically  to  zero  to  prevent  noise  bias. 
Several  algorithms  exist  [11,12]  for  the  decreasing  adaptive  gains* 

The  PRF  requirement  was  addressed  earlier.  If  a  priori  knowledge  of 
the  range  of  plant  parameters  exists  then  a  fixed  c^  compensator  can  be 
developed,  saving  much  computation  time  and  implementation  hardware.  How¬ 
ever,  in  general,  the  nonlinear  adaptive  compensator  must  be  used  to  ob¬ 
tain  the  PRF  requirement. 

The  outer  loop  of  the  nonlinear  identification  algorithm  consists  of 
the  pattern  recognition,  model  structure,  and  nonlinear  interval  blocks. 
Important  design  consideration  occurring  in  the  outer  loop  are: 

1)  Pattern  recognition  block 

2)  Model  structure  block 

a)  Model  order  (numerator,  denominator  degree) 

b)  Nonlinearity  location 

c)  State  information 

3)  Nonlinearity  interval  block 

a)  Interval  sizing 

b)  Number  of  intervals 

4)  Identification  time  frame 


- 
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The  pattern  recognition  block  must  determine  if  a  "possible"  nonlin¬ 
earity  has  been  identified.  This  block  decides  when  a  nonlinearity  des¬ 
cribed  by  a  set  of  points  is  Class  C1,  i  o,  to  qualify  as  an  allowable 


nonlinearity. 

Fig.  IV-2.  Define: 

a\  =  p2  -  P-, 

Alf2  =  P3  -  P2 

(4.3) 

A  *n-l  ^m  ^n-1 

the  "first  difference"  fo  the  set  of  points. 

Then 

A2f,  ■  A'fi+,  -  i'f, 

(4.4) 

and 

•  i*  -  Ai-lr  . i - 1  , 

4  fj  - 1  Vi  - 4  fj 

(4.5) 

represent  higher  differences  of  the  set  of  points.  Now  the  performance 

criteria: 

’f 

1  N  A  \ 

J  =  tt  E  - <  e  e  is  greater  than  zero 

Nj=i  v 

(4.6) 

i  -I  0 

defines  the  class  of  functions  C  where  only  the  A  j  that  differ  in 
sign  from  the  previous,  A1  f _-j »  are  used  to  define  the  class.  N  is  the 
number  of  sign  changes,  and  T^1  is  the  width  of  the  interval  between  the 
points. 

The  results  of  the  pattern  recognition  block  feed  into  the  model 
structure  block.  In  this  block  almost  all  of  the  decisions  concerning  the 
model  structure  and  nonlinearity  placement  are  made.  This  block  is  nearly 
always  "filled"  by  the  designer  himself. 

The  first  piece  of  information  necessary  from  the  model  structure 
block  is  the  model  order  and  preliminary  structure.  Several  model  order 
algorithms  exist  [13,14,15]  to  provide  possible  model  structures  and  in¬ 
formation  on  the  number  of  poles  and  zeros  for  the  model  and  any  time  de- 
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lays. 

The  placing  of  any  nonlinearities  in  the  afore  found  model  structure 
is  largely  a  matter  of  trial  and  error  or  intuition  as  to  what  states 
will  be  affected  by  the  nonlinearity.  By  minimizing  J  in  (4.6)  of  the 
nonlinear  pattern  recognition  block  with  respect  to  i  an  e  can  be  picked 
which  fixes  the  class  of  functions  allowable  for  that  particular  model 
state.  If  the  expected  plant  nonlinearity  was  not  of  this  class  then 
another  model  state  might  be  chosen  in  which  to  locate  a  model  nonlinea¬ 
rity. 

Since  both  plant  and  model  state  information  and  used  to  identify 
possible  nonlinearities,  it  is  important  that  the  proper  state  information 
is  obtained  to  get  the  correct  answer.  A  decision  must  be  made  whether  to 
use  the  noisy  plant  states,  themodel  states,  or  a  combination  of  the  two. 
The  problem  is  illustrated  in  Fig.  (IV-3).  As  can  be  seen,  at  t-j  the  ac¬ 
tual  plant  state  (unmeasurable  in  general)  is  in  interval  2  while  the  model 
state  is  in  interval  3  and  the  noisy  plant  state  is  in  interval  4  of  the 
interval ized  state  space.  This  problem  can  be  posed  as  an  optimal  com¬ 
munications  problem  where  a  decision  function: 

a  =  i  (*p) + 1  (4-7) 

is  defined  and  the  functions  f  and  £  are  chosen  to  minimize  the  probabil¬ 
ity  of  selecting  the  incorrect  interval.  Q,  then,  is  the  independent  var¬ 
iable  used  to  determine  the  interval  number  of  the  model's  state  space. 

The  nonlinearity  interval  block  decides  how  the  model's  state  spaces 
will  be  broken  up  in  order  to  identify  the  nonlinearities  (if  any)  exis¬ 
ting  in  the  corresponding  plant's  state  spaces.  This  problem  can  be  bro¬ 
ken  into  two  interrelated  parts:  1)  interval  size  and  2)  number  of  in¬ 
tervals.  Statistical  measurements  can  be  made  for  a  particular  input  to 
determine  how  the  Q's  of  (4.7)  range.  The  interval  size  can  then  be  cho- 


|V_3.  interval  Select  Problem. 
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sen  to  allow  for  uniform  (if  any)  convergence  of  the  parameters. 

The  number  of  intervals  presents  other  problems.  As  the  number  of 
intervals  increase,  the  amount  of  state  space  in  these  intervals  decrease. 
As  teh  SNR  of  the  independent  variables  decreases,  the  probability  of  an 
internal  misselect  increases.  Let 


yu=0  =  output  with  noise  present  and  no  input 

y  .  =  output  with  noise  present  and  nonzero  input  driving 
f  function 


SNR 


N  2 

1=1  v°‘u> 

N  . 

Wu> 


-  1 


(4.8) 


As  the  SNR  decreases,  the  number  of  intervals  the  nonlinearity  can  be 
broken  into  and  still  get  an  "allowable"  (in  the  sense  of  (4.6))  fit  de¬ 
creases,  (Number  of  Intervals) ©t SNR  (independent  variable),  where  the  pro¬ 
portionality  constant  is  designer-selected.  As  offline  test  for  the  proper 
number  of  intervals  is  given  using  the  Theil  criterion  [16]. 


ie  (it)2 


K  - 


E  Ixp  (It)2  ♦ 


l 


N  -I  2 

e  i  xm  (nr 
i-i  N  m 


(4.9) 


As  shown  in  Fig.  (IV-4),  for  a  particular  example,  an  optimum  number  of 
intervals  was  found. 

The  identification  time  frame  is  also  designer-selected.  In  general, 
the  longer  the  time  for  Identification,  the  more  accurate  the  final  answer. 
However,  in  practice  the  amount  of  time  must  be  weighed  against  the  speed 
of  parameter  adaptation  and  measurement  noise  levels  in  order  to  give  an 
optimum  adaptation  time. 
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V.  RESULTS 

The  response  error  MRAS  approach  was  tested  on  numerous  models, 
since  no  human  pilot  operating  records  were  available  from  FDL  at  Wright- 
Patterson  AFB,  Ohio.  The  examples  illustrate  the  good  parameter  track¬ 
ing  possible.  It  should  be  emphasized  that  since  no  optimal  control 
pilot  model  formulation  was  explicitly  a  part  of  this  study,  but  instead 
only  the  feasibility  of  MRAS  identification  for  plants  with  correlated 
noise,  results  and  their  interpretation  should  be  limited  to  the  scope 
of  MRAS  nonlinear  function  and  linear  parameter  estimation. 

Example  1  (No  Noise) 

••  •  • 

Plant:  xp  +  f(x)x  +  x  =  u 

where  f(x)x  is  the  saturation  function  shown  in  Figure  V-l 

Model:  +  allqxm  +  xm  *  bou 

bQ  *  constant 

a^  =  supposed  interval i zed  nonlinearity 
Using  the  interval  select  nonlinear  MRAS  approach,  with  c^s  constant. 
With  SVF  poles  at  -20  and  -30,  the  results  are  shown  in  Figure  V-l, 
with  noisy  measurements 

xavail  =  xp  +  n 
E{n }  *  0 

o  *  ►fTn7)  =  .05x„ 

P 

Example  2  (Noise) 


Plant: 


y(output)  *  xp  +  nx 


•*«*» 
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The  available  (measured)  u  is  u'  =  u  +  nu 
00 

u  =  Z  A. sin  w-t 
i=l  1 

wi  «  {.2,  .4,  .6,  .8,  1,  1.2,  1.4,  1.6} 

First,  a  linear  model  will  be  fit  to  the  system  and  then  a  nonlinear 
plant,  to  compare  the  improvement  in  tracking  accuracy  of  the  nonlinear 
version  over  that  of  the  linear  version.  The  linear  version  is 


G 

m 


(s) 


rHs) 


>11 


s  +  a21s  +  an 


and  the  nonlinear  version 


xm  '  u'  -  'A1  '  W 

*,  s  f3(xm>  *  f4<xm> 

/N 

Each  case  used  ci  values  varying.  The  nonlinear  case  used  5  intervals 
for  each  nonlinearity. 

The  results  for  the  linear  case  are  shown  in  Figures  V-2  through 
V-13.  The  nonlinear  case  is  shown  in  Figures  V-14  through  V-16. 

Results  show  that  the  linear  model  has  a  poor  fit  to  the  (actual) 
nonlinear  plant,  because  of  the  forced  fit,  or  lack  of  degrees  of  freedom, 
of  the  linear  model.  The  nonlinear  results,  on  the  other  hand,  show 
good  model-plant  correlation,  as  can  be  seen  in  Figure  V-16(b),  where  a 
phase  plane  of  y vs  ym  is  plotted  for  the  test  input.  If  the  model  were 
a  perfect  replication,  there  would  be  a  single  line  at  45°;  only  small 
variations  about  this  line  occur. 

A  complete  computer  program  listing  is  given  in  the  Appendix  of  the 
identifier  system  for  practical  nonlinear  identification  by  the  interval 
approach.  A  flowchart  is  shown  in  Figure  V-l 7 . 
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VI.  SUMMARY  AND  CONCLUSIONS 

The  response  error  MRAS  identification  can  result  in  meaningful 

A 

nonlinear  identification  if  set  correctly.  Chief  problems  include  c^ 
varying  by  interval,  noise  biasing  effects.  This  is  shown  in  Figure  VI-1 
and  2.  If  one  uses  fixed  c.  terms,  the  nonlinear  intervalized  response 

A 

acts  like  time  varying  a^t)  terms  for  the  plant.  Even  if  one  uses  varying 

A 

c.  terms,  c^ ,  there  is  the  sharp  time-varying  tracking  problem  as  different 
intervals  are  entered  (Figure  VI-2).  As  shown,  in  Figure  VI-3,  there  must 
be  vector  arrays  of  c.  terms,  the  vector  entries  being  for  different  in- 

A  /V  A 

tervals.  This  means  that  if  there  are  two  c^  terms,  c^  and  c2  ,  where 
£i  «  [  Ci  ,  c,  . c.|  ]  where  there  are  p  intervals  to  the  nonlin¬ 

earity. 

The  effect  of  the  number  of  intervals  in  the  presence  of  noise  has 
been  shown  to  be  a  parabola.  Figure  VI-4.  Too  few  intervals  yields  an 
"almost  linear"  fit,  and  too  many,  given  noise,  yields  nonsense  due  to  the 
interval  search  problem  discussed  previously. 

To  perform  total  human  operator  identification,  a  complete  Optimal 
Control  Model  (OCM)  computer  package,  plus  operator  remnant  construction, 
would  be  needed.  Such  work  was  beyond  the  scope  of  this  project,  but 
could  be  extended  from  the  present  results. 

The  methods  developed  here  do  provide  for  good  nonlinear  model  iden¬ 
tification,  vf  the  noise  levels  are  reasonable.  Work  is  underway  to  mini¬ 
mize  the  effects  of  the  large  correlated  noise  levels. 
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